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I. ABSTRACT 

We propose a Green Cloudlet Network (GCN) architecture to provide seamless Mobile Cloud 
Computing (MCC) services to User Equipments (UEs) with low latency in which each cloudlet 
is powered by both green and brown energy. Fully utilizing green energy can significantly reduce 
the operational cost of cloudlet providers. However, owing to the spatial dynamics of energy 
demand and green energy generation, the energy gap among different cloudlets in the network 
is unbalanced, i.e., some cloudlets’ energy demands can be fully provided by green energy 
but others need to utilize on-grid energy (i.e., brown energy) to satisfy their energy demands. 
We propose a Green-energy awarE Avatar migRation (GEAR) strategy to minimize the on- 
grid energy consumption in GCN by redistributing the energy demands via Avatar migration 
among cloudlets according to cloudlets’ green energy generation. Furthermore, GEAR ensures 
the Service Level Agreement (SLA) in terms of the maximum Avatar propagation delay by 
avoiding Avatars hosted in the remote cloudlets. We formulate the GEAR strategy as a mixed 
integer linear programming problem, which is NP-hard, and thus apply the Branch and Bound 
search to find its sub-optimal solution. Simulation results demonstrate that GEAR can save on- 
grid energy consumption significantly as compared to the Follow me AvataR (EAR) migration 
strategy, which aims to minimize the propagation delay between an UE and its Avatar. 


This work was supported in part by the National Science Foundation under grant no. CNS-1320468. Xiang Sun, Nirwan 
Ansari and Qiang Fan are with the Advanced Networking Laboratory, Department of Electrical and Computer Engineering, New 
Jersey Institute of Technology, Newark, NJ, 07102, USA. (Email: xs47, nirwan.ansari, qf4@njit.edu). 
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II. Keywords 
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III. Introduction 

The emergence of Mobile Cloud Computing (MCC) is enabling execution of computation¬ 
intensive applications (e.g., augmented reality and speech recognition) in a user equipment (UE), 
i.e., the UE can offload some tasks to high performance Virtual Machines (VMs) in a data center 
and VMs can help the UE execute these tasks in order to improve the task execution time 
and reduce the UE’s energy consumption. However, the existing MCC architecture suffers from 
the long communications latency between a UE and its VM in a remote data center as the 
communications link traverses the Wide Area Network (WAN) which does not guarantee any 
minimum QoS to the UE; it is also very hard to control the WAN latency 0 - According to a 
report Q, Amazon famously claimed that every 100 millisecond reduction in delay led to a one 
percent increase in sales. Google also stated that for every half second delay, it saw a 20 percent 
reduction in traffic. Therefore, reducing the latency can bring a huge benefit to the application 
providers. The concept of cloudlets has thus been proposed to reduce the propagation delay 
between a UE and its VM [|T|. A cloudlet is a tiny version of the data center and is located 
close to the UE, and so communications between the UE and its VM can be established via the 
local area network (LAN). 

To reap benefits of cloudlets and make them sustainable, we propose the Green Cloudlet 
Network (GCN) architecture as shown in Eig.[^ Since the existing ETE network infrastructure can 
provide seamless connection between a UE and its eNB, each eNB is connected with a cloudlet 
via high speed fiber so that UEs can utilize the MCC technology everywhere. Meanwhile, the 
cloudlet is so close to the UE that the propagation delay is minimized. Each MCC UE subscribes 
one Avatar, a high performance VM in the cloudlet, to help run different tasks and provide extra 
storage space. Avatars are software clones of their UEs and always available to UEs when UEs are 
moving from one area to the others [|^. Moreover, in order to overcome the inefficient structure 
of the traditional Evolved Packet Core (EPC) network (i.e., the control plane and the data plane 
are centralized in the Packet data network Gate Way (P-GW) and Serving GateWay (S-GW) Q), 
Software Defined Network (SDN) based cellular core network Q has been proposed in the GCN 
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Fig. 1. Green cloudlet network architecture. 


architecture in order to decouple the control plane (which is implemented in the SDN controller) 
and data plane (which is implemented in openflow switches) and provide efficient and flexible 
communications paths between Avatars in different cloudlets or between UEs in different eNBs. 

GCN facilitates communications between a UE and its Avatar, but the distributed cloudlets 
increase the operational cost of cloudlet providers and CO 2 emission, i.e., a huge amount of on- 
grid energy (we assume energy from the power grid is brown energy, and thus the terms on-grid 
energy and brown energy are interchangeable for the rest of paper) will be consumed in order 
to maintain the GCN infrastructure. In order to reduce on-grid energy, greening is introduced in 
the GCN architecture, i.e., each cloudlet is powered by green energy generated from solar panels 
or other green energy collectors and uses on-grid energy as a backup. The power supply system 
of each cloudlet is shown in Eig. in which the green energy collector absorbs energy from 
the green energy source (i.e., solar radiation) and converts it into electrical power, the charge 
controller regulates the electrical power from the green energy collector, and the electrical power 
is converted between AC and DC by the inverters. The smart meter records the electric energy 
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from the power grid eonsumed by the eloudlet and eNB. Note that green energy in Fig. is 
only available to the eloudlet in this system. Certainly, eNBs ean be equipped with its own green 
energy supply system as well, but green energy from the same green energy eolleetor eannot 
be shared by the eloudlet and the eNB simultaneously (beeause the eloudlet provider and the 
LTE network provider play different roles in the network. Thereby, they would not share the 
infrastrueture with eaeh other). Thus, green energy supplements of the eloudlet and the eNB 
are independent with eaeh other. In this paper, we only eonsider how to effieiently utilize green 
energy by eloudlets in the network. 

Owing to the spatial dynamies of the distribution of UEs among different eNBs’ eoverage 
areas and the dynamies of applieation loads among Avatars, different eloudlets may require 
different energy demands for running the applieation loads of the hosting Avatars. Meanwhile, 
green energy generation also exhibits spatial dynamies. Therefore, some eloudlets, whieh have 
less energy demand and more green energy generated, would have exeess of green energy. 
Conversely, some eloudlets, whieh have more energy demand and less green energy generated, 
would pull energy from the power grid (non-renewal). Sueh unbalaneed energy gap (energy 
demand minus green energy generation) among different eloudlets inereases the on-grid energy 
eonsumption. Therefore, fully utilizing green energy ean tremendously reduee the on-grid energy 
eonsumption, and thus potentially deereases the operational eost of the eloudlet providers and 
CO 2 emission. In this paper, we propose the Green-energy awarE Avatar migRation (GEAR) 
strategy to minimize the on-grid energy eonsumption in GCN by redistributing the energy 
demands in terms of migrating Avatars among eloudlets aeeording to eloudlets’ green energy 
generation. Meanwhile, GEAR also guarantees the SEA, whieh is defined as the maximum 
Avatar propagation delay, i.e., the maximum propagation delay between the UE’s eNB (the eNB 
whieh is serving the UE) and the UE’s Avatar (the propagation delay between the UE’s eNB and 
UE’s Avatar may beeome higher over time, beeause the UE may move away from the original 
plaee or UE’s Avatar may migrate to the eloudlet whieh is far away from the UE, and so the 
propagation delay may beeome humongous). 

The rest of the paper is organized as follows. In Seetion II, we briefly review the related 
works. In Seetion III, we setup a power eonsumption model of a eloudlet. In Seetion IV, we 
formulate the avatar migration strategy in order to minimize the on-grid energy eonsumption. 
In Seetion V, we demonstrate the viability of GEAR via simulation results. The eonelusion is 
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Fig. 2. The power supply system of the cloudlet. 


presented in Seetion VI. 


IV. Related Works 

Previous works ||T| Q have proved that eloudlets ean signifieantly reduee the eommunieations 
latency between UEs and VMs in the cloudlet. Tarik and Ksentini Q introduced a follow-me 
cloud, i.e., a UE’s service is continuously migrated to the data center which is much closer to 
the UE. Eollow-Me Cloud tries to minimize the propagation delay between a UE and its VM in 
the data center, but it does not capitalize on green energy to optimize the energy consumption. 

Rather than considering the communications latency between a UE and its VM, many works 
have focused on optimizing energy usage in Internet-scale Data Centers (/DCs). Studies |(8| Q 
pT] | have aimed to minimize the electricity cost in IDCs which are only powered by 
brown energy, i.e., the workloads are migrated from high electricity cost IDCs to low electricity 
cost IDCs. Gkatzikis and Koutsopoulos p3| showed that introducing green energy in the cloud 
can significantly reduce the usage of brown energy, but there is a big challenge to match the 
dynamic green energy generation and dynamic energy demands of data centers in the green 
cloud network. Hatzopoulos et al. p^ assumed each task request is assigned to one VM and 
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they tried to alloeate running VMs into different data eenters so that the total eost of power 
eonsumption in the green eloud network is redueed and the deadline of eaeh request’s response 
time is ensured. By eonsidering the daily/seasonal effeets of the green energy supplement in eaeh 
geographieal data eenter, Chen et al. p3| proposed a holistie workload seheduling algorithm in 
order to minimize the brown energy eonsumption aeross all the data eenters. Studies [16| 
proposed the similar idea. Both of them design a profit maximization strategy whieh is to assign 
the ineoming workloads among geo-distributed green data eenters by eonsidering the priee of 
eleetrieity, renewable power generation and SLA parameters. 

As eompared to the previous efforts, this paper presents several enhaneements. First, GCN 
is implemented in order to provide seamless MCC serviees to UEs with lower and eontrollable 
eommunieations lateney. Different from traditional energy optimization in the green eloud net¬ 
work, SLA is defined as the maximum Avatar propagation delay (i.e., the propagation delay 
bound between a UE’s eNB and UE’s Avatar), and so our objeetive is not only to minimize the 
on-grid energy but also to guarantee the predefined SEA for eaeh UE in GCN. Ensuring the SEA 
is important for eloudlet providers, beeause eaeh UE is moving over time and UEs’ Avatars may 
migrate to the eloudlet with higher green energy generation and lower energy demands. Thus, 
some UEs’ Avatars may be far away from themselves leading to the high propagation delay. As 
mentioned previously, the unbearable lateney degrades the performanee of MCC applieations. 
Thus, guaranteeing the maximum propagation delay for eaeh UE is an important faetor to be 
eonsidered when we design an optimal Avatar migration strategy. To the best of our knowledge, 
existing literature has not addressed this issue. Seeond, we propose a novel live Avatar migration 
strategy, i.e., GEAR, to aehieve our objeetives, and demonstrate the reduetion of on-grid energy 
eonsumption without violating the SEA via extensive simulations. 


V. System Model 

Cloudlets are distributed in the network powered by both on-grid and green energy. We assume 
that the servers in GCN are homogeneous, i.e., the eonfiguration of eaeh server is the same. 
Every UE’s Avatar is also homogeneous, but the applieation loads of different UEs’ Avatars 
are different. So, eaeh server ean host a fixed number of Avatars r, but the applieation loads 
on different servers vary. The eloudlet provider plays the role of an Infrastrueture as a Serviee 
(laaS) provider, i.e., the eloudlet provider supplies virtualized eomputing resourees in terms of 
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Avatars to UEs. Although the provider does not impose any SLA of applieations onto Avatars, 
it does ensure the SLA to ULs, i.e., the maximum Avatar propagation delay e. 

As mentioned earlier, Avatar migration is enabled to adjust the energy demand among the 
eloudlets. However, live migration may eost several seeonds or minutes to aetivate an Avatar 
moving from the souree server in one eloudlet to the destination server in another eloudlet, 
and so proaetive migration deeision should be made, i.e., the deeision maker should determine 
eaeh Avatar’s loeation (i.e., in whieh eloudlet) in the next time slot based on the predietion of 
the energy demand and the green energy generation of eaeh eloudlet. The hourly solar energy 
generation ean be estimated by using typieal annual meteorologieal weather data for a given 
geoloeation p^ . Meanwhile, the estimation of the eloudlet’s energy demand ean be ealeulated 
by means of foreeasting the power eonsumption of eaeh aetive server in the eloudlet as will be 
diseussed later by setting up the aetive server power eonsumption model. 

In order to identify the loeation of different Avatars, two indieator funetions 5(7, k) and r]i{j, k) 
are introdueed where i is the index of eloudlets in the network, j is the index of servers in one 
eloudlet, and k is the index of Avatars in the network. So, 6{i,k) = 1 implies that Avatar k is 
loeated in eloudlet i. Meanwhile, r]i{j, k) = 1 indieates that Avatar k is in eloudlet Ls server j. 
Therefore, 

Tli 

Hhk) = ( 1 ) 

7=1 

where n* is the number of aetive servers in eloudlet i and it is a funetion of 6{i, k): 


'Y.5{i,ky 

k 

rii = - 

T 

where r is the number of Avatars hosted in the server. 


( 2 ) 


A. Server Power Consumption Model 

In this seetion, we model the power eonsumption of aetive servers in a eloudlet. The power 


eonsumption of aetive server j in eloudlet i ean be eharaeterized as follows [19|: 


Pu = p^ + pyy + a X 








( 3 ) 


where Pij is the total power eonsumption of aetive server j in eloudlet i; P* is the power 
eonsumption of the server when it is in the standby mode, i.e., when the server’s CPU load is 
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zero; P^Y is the power eonsumption of server j for doing virtualization and we will diseuss it in 
the next paragraph; is the power eonsumption of server j for running different applieations 
on its hosting Avatars, where is server j’s CPU usage for running Avatar i’s applieation 
load and a is the eoeffieient that maps the CPU usage into the power eonsumption. So, if the 
CPU usage for running Avatar fc’s applieation load is then the server j’s CPU usage ean 
be eonsidered as a funetion of T]i(j,k): 


, “pp _ 




X u 


app 


( 4 ) 


As mentioned earlier, P^Y is the power eonsumption of server j for performing virtualization, 
and it ineludes two parts [19]: 

(5) 


yvir _ Tjhyper 


■pvir _ jjii 


I 


idle 


where is the power eonsumption of server j in eloudlet i for running a hypervisor (i.e., 

a VM manager) without any Avatar load (i.e., the hypervisor only manages the eonfiguration 
of different Avatars in the server). In order to determine the power eonsumption of an idle 


hypervisor, Warkozek et al. [19| showed that P^^^^ is proportional to the number of Avatars 
hosted in the server, i.e., the more Avatars server j hosts, the more power is eonsumed on the 
hypervisor for eonfiguring these Avatars: 


p"r=^ ( 6 ) 

k 

where indieates the total number of Avatars in sever j and Y is the Avatar power 

eoeffieient, whieh is the power eost of the hypervisor for maintaining one Avatar. P-^^ in Eq. (5) 
is the power eonsumption of Avatars in the idle mode (Avatar does not take any applieation load 
from UE, but runs basie system operation instanees) in server j of eloudlet i. P-f^ is determined 
by the number of Avatars in server j and the amount of CPU usage for running the operating 
system (OS) kernel instanees for eaeh idle Avatar. Assuming that all UEs’ Avatars use the same 
OS, thereby CPU usage for running the OS kernel instanees is the same for all Avatars. 
Therefore, we have 

k 


( 7 ) 
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Substituting Eqs. (4)-(7) into Eq. (3) yields the power eonsumption of server j in eloudlet i 
as follows: 

P,j = + U, k) + J2 h iP k)x a + uD] (8) 

k k 

Sinee the servers in the eloudlet network are homogeneous, P^ and a, whieh are eonstants, 
ean be pre-determined. Meanwhile, if all servers are installed with the same type of hypervisor, 
sueh as Hyper-V, ESX or Xen, then /3 is the same for all servers. We define Uk = 
as the total CPU usage (ineluding OS kernel CPU usage and applieation load CPU usage) for 
running Avatar k in the server, and so Eq. (8) ean be expressed as: 

Phj = P" + 1^ (j, ^) + X] [Vi (j, k) X aUk] (9) 

k k 


B. Cloudlet Power Consumption Model 


Aside from running the eooling system and eloudlet network equipment, the major power 
eonsumption of a data eenter is the power eonsumed by the aetive servers. However, a eloudlet 
is a tiny version of the data eenter that does not need to maintain a powerful eooling system and 
plenty of switehes, and so we assume all the power eonsumption of a eloudlet is eontributed by 
the eomputing equipments sueh as servers, and we ealeulate eloudlet i’s power eonsumption as 
the sum of the power eonsumption of the aetive servers: 

rii rii Ui 

Fi = ^ Fij = UiP" + (^ + idi U, k) X auk] (10) 

j=l j=l k j=l k 

5(i k) S(i k) 

By approximating Eq. (2) into Ui ~ ^ ’ and substituting Eq. (1) and rii ~ ^ ’ into Eq. 

(10), we have the power eonsumption of eloudlet i: 


P 


E 


p 

6 {i,k) X ( — + /3 + auk 


( 11 ) 


C. Avatar Propagation Delay Model 

Usually, a UE and its Avatar may not assoeiate with the same eNB. As mentioned previously, 
UEs are moving over time and Avatars migrate to the eloudlet with more green energy generation 
and less energy demands. Thus, the eommunieations between a UE and its Avatar might traverse 
SDN based eellular eore network. As shown in Eig. if UE 1 tries to eommunieate with its 
Avatar (i.e.. Avatar 1 in eloudlet B), the eommunieations path should traverse eNB 1, openflow 
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Fig. 3. The communications between a UE and its Avatar 

switches, eNB 2 and cloudlet B. Thus, the communications delay between a UE and its Avatar 
comprises three parts: wireless communications delay between the UE and its eNB, propagation 
delay between the eNB and the cloudlet where the UE’s Avatar is located, and the propagation 
delay within the cloudlet. However, the wireless communications delay is determined by the 
UE’s billing plan and the ETE network provider’s bandwidth allocation strategy which are not 
controlled by the cloudlet provider. Meanwhile, we assume the propagation delay within the 
cloudlet is negligible. So, we define Avatar propagation delay as the latency for propagating one 
packet between the UE’s eNB and its cloudlet. Cloudlet providers only need to guarantee the 
SEA in terms of maximum Avatar propagation delay for each UE. 

If the UE’s Avatar is located at cloudlet i and the UE is associated with eNB e (e is the index of 
eNB in GCN), we can express the Avatar propagation delay as Tj^e, which comprises two parts: 
i.e., the propagation delay for transmitting a packet between cloudlet i in which the UE’s 
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Avatar resides and the UE’s eNB e; i.e., the total proeessing delay for all the openflow 

switehes on the routing path in proeessing one paeket. Assume is proportional to the 


distanee die [20|, i.e., the distanee between eloudlet i in whieh the UE’s Avatar resides and the 


UE’s eNB e, i.e., oc di^e ■ Meanwhile, if we assume that the number of openflow switehes 
on the routing path is also proportional to di^e (i-C-, the longer distanee between Avatar’s eloudlet 
and the UE’s eNB, the more openflow switehes the paeket needs to traverse) and the average 
paeket proeessing time on every openflow switeh is the same, then is also proportional to 
di^e, i-e., Tfe“ cx: di^e ■ So, we eonelude that: 


Ti^e = cr X di^e X d {i, k) 


( 12 ) 


where a is the eoeffieient that maps the distanee to the time delay. Assume the loeations of 
eaeh eNB and its eloudlet are known; note that Avatar is traeking the loeation of its UE all the 
time. Therefore, given the loeations of eaeh eNB and eloudlet, d* e is a eonstant. Thereby, Avatar 
propagation delay is a funetion of 5{i,k). 


VI. Problem Eormulation 

Owing to the spatial dynamies of energy demand and green energy generation among different 
eloudlets, energy demand of some eloudlets ean be met by green energy, but some eannot 
and need to eonsume on-grid energy. Meanwhile, owing to the disadvantages of banking green 


energy , we assume that green energy is disinelined to be stored for eaeh eloudlet [|22|. 
Therefore, green energy should be fully utilized in eaeh time slot so that the on-gird energy ean be 
minimized. Denote pi as the on-grid energy eonsumption of eloudlet i, i.e., pi = max[0, AT(Pi — 
Gi)\, where AT is the length of one time slot; Pi and Gi are the power demand and the green 
power generation of eloudlet i. The objeetive of the GEAR strategy is to minimize the on-grid 
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energy consumption of GCN in each time slot. So, we formulate GEAR as follows: 


min y^Pi 

S{i,k) ^ 
i 

(13) 

s.t. Vi, Pi > 5 (f, k) X + (3 + au}^ — Gi, 

(14) 

Vf, pi > 0, 

(15) 

V/c, adi^eS {i, k) < e, 

(16) 

Vi, - > (5 (f, k) < mi, 

k 

(17) 

Mk, J2^ikk) = l, 

(18) 


i 


where 6{i,k) is a binary variable indicating the location of Avatars, e is the SLA provided by 
the cloudlet provider, and rrii is the capacity of cloudlet i, i.e., the total number of servers owned 
by cloudlet i. Constraints (14) and (15) indicate pi = max(0,Pi — Gi). Constraint (16) means 
the cloudlet provider should guarantee the SLA for all UEs. Constraint (17) implies that the 
total number of Avatars assigned to the cloudlet should not exceed the cloudlet’s capacity and 
Constraint (18) means each Avatar should be assigned to no more than one cloudlet. 

Theorem 1: The problem of minimizing the on-grid energy consumption of GCN is NP-hard. 

Proof: Suppose there are 2 cloudlets in GCN (i.e., i = 2) and the capacity of each cloudlet 
is infinite (i.e., mi = m 2 = +C)o). Meanwhile, every Avatar can migrate to any of the two 
cloudlets without violating Avatar propagation delay constraint (i.e., e = +cx)). Moreover, 
green energy generation of each cloudlet is the same which equals to Q (i.e., Gi = G 2 = 
^ = Q) and the total energy consumption of the network is equal to the 

total green energy generation (i.e., Y^f^i Pi = 2Q). So, the original problem is converted to the 
following: 

2 

min AT max (Pj —(5,0} (19) 

5{i,k) ' ^ 

2 = 1 

2 

s.t. ^Pi = 2g, (20) 

2=1 

where Pi = Ylk + /S + ocpk)} ■ Obviously, the optimal solution for minimizing the 

total on-grid energy consumption of GCN is to assign the total energy demands into the two 
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cloudlets equally, i.e., Pi = P 2 = Q, whieh ean be eonsidered as the partition problem (i.e., a 
well know NP-hard problem). So the problem of minimizing the on-grid energy eonsumption of 
the GCN is NP-hard. ■ 

To solve GEAR (whieh is a mixed integer linear programming problem), we use the Braneh 


and Bound seareh method [231 to find the sub-optimal solution to the problem. Therefore, in eaeh 
time slot, eaeh Avatar estimates its average CPU utilization for the next time slot by adopting 


the CPU workload predietion model [24| [251, aequires the loeation of its UE, and reports the 
information to the GCN manager. The GCN manager, i.e., a eentral eontroller in GCN, deeides 
the loeation of all Avatars by solving the above optimization problem. 


VIE Simulation Result 

TABLE I 

System Parameter 


Parameter 

Value 

The length of time slot, AT 

15 mins 

Capacity of server, r 

16 Avatars 

Power consumption of standby server, P‘‘ 

80 Watts 

CPU usage to power mapping coefficient, a 

0.2 %CPU/Watts 

Avatar to power mapping coefficient, (5 

0.3 Watts/Avatar 

Distance to delay mapping coefficient, cr 

3.33 ms/km 

SLA, e 

10 ms 


We simulate the proposed GEAR strategy in GCN. Eor eomparisons, we seleet the other 
Avatar migration strategy, i.e., Eollow me AvataR (FAR) migration strategy. The idea of EAR is 
similar to the previous work Q, whieh tries to minimize the propagation delay between a UE 
and its VM in the eloud. Similarly, EAR does not minimize the on-grid energy eonsumption but 
minimizes the propagation delay between a UE and its Avatar by seleeting the nearest eloudlet 
as the host of the UE’s Avatar (i.e., when the UE moves from one eNB eoverage area to the 
other eNB eoverage area, its Avatar also migrates eorrespondingly). Some system parameters 
are listed in Table I. 










14 



Fig. 4. Network topology 



Fig. 5. Average solar radiation generated at different time 
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Fig. 6. On-grid energy consumption at different time 
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Avatar Migration Strategies 


Fig. 7. Total on-grid energy consumption in one day 


To demonstrate the viability of GEAR, we set up a network with the topology shown in Fig. 
which includes 16 cloudlet-eNB combinations (4x4) in a square area of 64 km^. The coverage 
of each eNB is a square area of 4 km‘^. The whole area is divided into 2 parts, i.e., urban and 
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Fig. 8. Total on-grid energy consumption over the number of UEs in GCN 



Total number of UEs 

Fig. 9. Total on-grid energy consumption over different values of k 


rural areas. Initially, each cloudlet’s capacity rrii in terms of the number of servers is randomly 
chosen between 10 and 30, and UEs are uniformly distributed in the network. The location of 
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each Avatar is initially chosen to be its nearest cloudlet. Each Avatar’s CPU is assigned by one 
physical core in the server and the CPU utilization of each Avatar is randomly chosen between 
10% and 100% in each time slot (we assume the OS kernel instances cost 10% of the Avatar’s 
CPU utilization). Each server can host 16 Avatars at most. 


A. Spatial Dynamics of Energy Demand 

Energy demands of different cloudlets in GCN exhibit spatial dynamics, and so we setup the 
simulation scenario as follows: UE mobility adopts the modified random waypoint model, i.e., 
each UE randomly selects a speed between 0 and 10 m/s in every time slot and moves toward 
its destination, and the locations of UEs’ destinations (i.e., the values of x and y coordinates) 
are randomly selected according to a normal distribution N(4 km,\A km), which implies that 
UEs more likely move toward the center of each urban area (i.e., based on the characteristics of 
the normal distribution, UEs more likely select their destinations which are close to the center 
of the network). Eor the green energy generation, we use the local daily solar radiation data 


trace (Millbrook, NY in Jan. 1st, 2015) from National Climatic Data Center p6| , as shown in 
Eig. 1^ where each point indicates the average solar radiation within the current hour. Assume 
the size of the solar cell equipped in each cloudlet is 5 m^ and the efficiency for converting 


solar radiation into electricity is 46% [27|. Also, suppose the green energy generated in different 
cloudlets is the same in the same time slot. Eig. shows the total on-grid energy consumption 
of two Avatar migration strategies in different time slots. When there is no or little green energy 
provision in GCN (from 8 a.m. to 9 a.m.), there is no difference between the two live migration 
strategies since all the cloudlets are powered by on-grid energy. However, when more green 
energy is generated at each cloudlet, GEAR can save more on-grid energy than EAR, since 
GEAR can migrate Avatars from the cloudlets with higher energy demand to the cloudlets with 
lower energy demand so that green energy can be fully utilized. Eig. shows the total on-grid 
energy consumption in GCN in the whole day; note that GEAR saves 35% on-grid energy as 
compared to EAR. 

We next examine the effect of the density of UEs by increasing the number of UEs from 600 
to 1400. More UEs in the network result in more out-of-balanced energy demand between the 
urban area and the rural area because all the UEs prefer to go to the urban rather than the rural 
area (according to the simulation set-up that we mentioned previously). Eig. shows the total 
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on-grid energy eonsumption in one day with respeet to different numbers of UEs in the network. 
We ean see that when the number of UEs inereases from 600 to 1100, the differenee of the total 
on-grid energy eonsumption between GEAR and EAR is inereasing, i.e., if the energy demand is 
more unbalaneed between areas, GEAR ean save more on-grid energy as eompared to EAR by 
balaneing the energy gap among the eloudlets. However, as the number of UEs exeeeds 1100, 
the differenee of the total on-grid energy eonsumption between GEAR and EAR remains statie 
beeause green energy has already been fully utilized by GEAR when the number of UEs reaehes 
1100, and if the energy demands are still inereasing, on-grid energy has to be tapped. 


B. Spatial Dynamics of Green Energy Provision and Energy Demand 

In the real environment, not only the energy demand but also the green energy provision 
may exhibit spatial dynamies, i.e., the solar eell in different eloudlets may generate different 
amount of green energy beeause of the position of the sun, the spatial dynamies of atmospherie 
eonditions, ete. Also, evidenee shows that the solar radiation of the rural area is greater than the 


urban area [281. Therefore, we setup the simulation seenario as follows: the UE’s parameters 
are the same as in the previous simulation seenario and the hourly average solar radiation in 
the rural area still follows the data traee as shown in Eig. However, the hourly average solar 
radiation in the urban area is redueed by pereentage (the value of is seleeted from 0% to 30% 
in the simulation). Eig. shows the total on-grid energy eonsumption of the network in one day 
with respeet to different values of n. Note that as the value of n inereases (i.e., hourly green 
energy generation is getting less in the urban area and the energy gap between the two areas is 
getting larger), EAR eonsumes more on-grid energy beeause the energy gap of the urban area is 
getting larger, and GEAR ean save more on-grid energy as eompared to EAR by balaneing the 
energy gap between the two areas. 


VHI. Conclusion 

In this paper, we have proposed the GCN arehiteeture to provide seamless and lower lateney 
MCC serviees to UEs, i.e., UEs ean offload tasks to their powerful Avatars with shorter prop¬ 
agation delay. However, owing to the spatial dynamies of energy demand and green energy 
provisioning, a signifieant amount of green energy is wasted, thus resulting in more grid energy 
eonsumption. Therefore, we have proposed the GEAR strategy to redistribute the energy demand 
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by migrating Avatars among cloudlets according to cloudlets’ green energy generation and to 
guarantee the maximum Avatar propagation delay. Simulation results have demonstrated that 
GEAR can significantly save on-grid energy as compared to the FAR strategy. 

In the future, we will consider the heterogeneous nature of the cloudlets, i.e., the configurations 
of the servers in GCN are different, and UEs can choose different configurations of VMs as their 
Avatars. Also, Avatar migration cost will be considered in the optimal Avatar migration strategy. 
Moreover, we will also consider the scenario in which a cloudlet and an eNB in the same location 
can share green energy and both of them can also generate different energy demands in different 
time slots. It is a big challenge to design an optimal Avatar migration strategy by considering 
the energy demands of eNBs and cloudlets. 
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